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Abstract. We study one-head machines through symbolic and topolog- 
ical dynamics. In particular, a subshift is associated to the system, and 
we are interested in its complexity in terms of realtime recognition. We 
emphasize the class of one-head machines whose subshift can be rec- 
ognized by a deterministic pushdown automaton. We prove that this 
class corresponds to particular restrictions on the head movement, and 
to equicontinuity in associated dynamical systems. 
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We study the dynamics of a system consisting in a finite automaton (the 
head) that can write and move over an infinite tape, like a Turing machine. 
We use the approach of symbolic and topological dynamics. Our interest is to 
understand its properties and limitations, and how dynamical properties are 
related to computational complexity. 

This approach was initiated by Kurka in [1] with two different topologies: 
one focused on the machine head, and the other on the tape. The first approach 
was further developed in [2, 3]. More recently, in [4, 5], a third kind of dynamical 
system was associated to Turing machines, taking advantage of the following 
specificity: changes happen only in the head position whilst the rest of the con- 
figuration remains unaltered. The whole evolution can therefore be described by 
the sequence of states taken by the head and the symbols that it reads. This 
observation actually yields a factor map between Kurka's first dynamical system 
and a one-sided subshift. 

In [4], it has been proved that machines with a sofic subshift correspond to 
machines whose head makes only bounded cycles. We prove here a similar char- 
acterization of machines with a shift that can be recognized by a deterministic 
pushdown automaton. Moreover, we establish links between these two properties 
and equicontinuity in all three spaces. 

In the first section, we recall the definitions and fundamental results. The 
second section is devoted to denning the different dynamical systems associated 
to one-head machines, and to stating basic results about equicontinuity within 
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these systems. In the last section, we define the class of bounded-zigzag machines 
and state our main results. 

1 Preliminaries 

Consider a finite alphabet A, and M to stand either for N or for Z. For a finite 
word u £ i*, we will note \u\ its length, and index its letters from to \u\ — 1, 
unless specified otherwise. We denote A- m the set of words on A of length at 
most to G N. If i, j G Z and i < j, [i, j] will denote the closed interval of integers 
fi,jf = p, j — 1], etc. A point x G A M will be called configuration. For 
a configuration or a word x, we define x^jj = x, . . .Xj. AU B will denote the 
disjoint union of two sets A and B. 

1.1 Topological dynamics 

A dynamical system (DS) is a pair (X, F) where A is a metric space and F a 
continuous self-map of A. Sometimes the space will be implicit. 

The orbit of a point x G X is the set of the F t (x) for all iteration t > 0. A 
point x is called preperiodic if there exist two naturals q, p such that F q+P (x) = 
F q (x). If q and p are minimal, then q is called the transient and p the period. 
When t — 0, x is called periodic. 

A point x G A is isolated if there is an e > such that the ball of radius e 
and center x contains only x. A point x G A is equicontinuous for F if, for any 
e > 0, there exists some 5 > such that, for any y G A with d(x, y) < <5, we have 
that, for all t G N, d(F t (x) , F* (y)) < e. The DS (A,F) is equicontinuous if, for 
any e > 0, there exists some S > such that, for any x, y G A with <i(x, y) < <5, 
we have that, for all t G N, cZ(F* (x) , F* (y)) < e. When A is compact, this 
is equivalent to having only equicontinuous points. The DS (A, F) is almost 
equicontinuous if it has a residual set of equicontinuous points. 

A DS (A, F) is a factor of a DS (Y, G) if 0G = F<f> for some continuous onto 
map (f) : Y — > A, then called a factor map. 

1.2 Subshifts 

We can endow the space A M of configurations with the product of the discrete 
topology of A. It is based on the cylinders [u]i = { x G A M | xjj . i+fc [ = u), where 
i G M, k G N and aei'; this notation shall be extended to semi- infinite words. 
If M = Z, u G A 2r+1 and r G N, we note [u] = [u]_ r . 

This topology corresponds to the metric d : x, y t-¥ 2^ min!C i* y i^ . In other 
words, d(x,y) < 2~ % <^> = J/[-»,t]i two points are "close to each other" 

if they coincide " around position 0" . It is easy to extend this metric to spaces 
A M x Q and A M x Q x Z. In that setting, A M and A M xQ are compact, but 
A M x Q x Z is not. 

The s/w/it map is the function a : A M —> A u defined by a(x)i — Xi+i. A 
subshift £ is a closed subset of A M which is also invariant by a. It can be seen 
as a compact DS where the map is a. 



A subshift E is characterized by its language, containing all finite patterns 
that appear in some of its configurations: C{E) = { z E E and i,j E M}. 
We denote C n (E) = C(E) fl A n . If the language C{E) is regular, then we say 
that E is sofic. Equivalently, a sofic subshift can be seen as the set of labels of 
infinite paths in some finite arc-labeled graph; this graph basically corresponds 
to the finite automaton that recognizes its language, without initial nor terminal 
state. 

Any subshift can also be defined from a set of forbidden finite patterns J- C 
A* by E = { z E A M \ Vi, j E M, z^jy £ J 7 } . If T can be chosen to be finite, then 
E is a subshift of finite type (SFT) . 

A DS F on A M is completely determined by the family of its factor subshifts, 
i.e. the factors which are also subshifts in some alphabet. Up to some letter 
renaming, all factor subshifts of F are of the form (7 ? (F J '(a;)))j e N, where V is a 
finite partition of X into closed open sets, and P(y) denotes the unique element 
of this partition which contains y E X . 

1.3 Deterministic pushdown automata 

Definition 1 A deterministic pushdown automaton (DPDA) is a tuple 
(A, ft, r, J_, A, o , F) where A is the input alphabet, Q is the set of states , r is 
the stack alphabet, _L E r is the stack bottom, o is the initial state, F C fi is 
the subset of terminal states and A : AxfixT^Qx F- 2 is the transition 
function such that: if X(a, o, _L) = (o',fi), then /x contains exactly one _L, which 
is on its end, and if X(a,o,f3) — (o',/i) with f3 ^ _L, then \i does not contain any 
_L. 

An (infinite) arc-labeled graph G is associated to the automaton. Its set of 
vertices is £2 X (T\ {_!_})*_!_, and there exists an arc from (e, /i) to (/, v) labeled 
a if and only if v — p^\^_\y and X(a,e,fio) — (f,P)- The word \i is called the 
stack content. 

The language L recognized by the automaton consists of all words w in A* 
such that there exists a finite path in G with label w, starting on vertex (oo,-L) 
and ending in some vertex (o,fi) with o E F. A subshift is recognized by the 
automaton if its language is recognized by the automaton. 

2 Turing Machines 

In this article, a Turing Machine (TM) is a triple (A, Q,S), where A and Q are 
the finite tape alphabet and set of state, and 8 : AxQ — > AxQx{— 1,1} the rule. 
We do not particularize any halting state. We can see the TM as evolving on a 
bi-infinite tape. The phase space is X — A z xQxZ. Any element of X is called 
a configuration and represents the state of the tape, the state of the head and 
its position. We consider here the topology introduced in Section 1.1. Thus, the 
farther the head is from the center, the less important become the read symbols, 
but the head state and position remain important. On this (non-compact) space, 
T : X -> X by T(x,q,i) = {x^^^ax^^p, i + d) if 5(x t ,q) = (a,p,d) gives 



the corresponding DS. We can extend the shift function to TM configurations 
by a : (x, q, i) i-> (a(x),q, i — 1), and it clearly commutes with T. 

We can represent the head state and position by adding a "mark" on the 
tape. If we want a compact space, this corresponds to the following phase space: 

X H = {x e (AU (A x Q)f \ \{i eZ\ Xi eAx Q}\ < 1} 

where the head position is implicitly given by the only cell with a symbol in (A x 
Q), and the function T H : X H — > X H is defined by T H (xj_ 00ii i(b, g)z]i,oo[) = 
y}-oo,i+dl(yi+d,p)y}i+d,ool, where y = X]_ 00 ^jax 1 ^ oo[ and S(b,q) = (a,p,d), and 
Tjj(x) = x if x does not contain any symbol in Ax Q. With the topology of Xh 
as a subshift of (A U (A x Q)) z , the head state and movement are less important 
when the head is far from 0. This model corresponds to the TM with moving head 
defined by Kurka in [1], which highlights the tape configuration. It is a particular 
case of cellular automaton, i.e. based on some uniformly-applied local rule. We 
can intuitively see a continuous injection <P : X — > Xh such that <PT = Th<$> and 
<Pa = a<P. 

Focusing on the movements and states of the head, [1] also defines the system 
with moving tape Tt '■ Xt —> Xt on the (compact) space 
X T = A z x Q by T T (x,q) = (o- d (xj_ oofi iaxj ^ oo ij,p) if S(x ,q) = (a,p,d). 
Here the head is assumed to be always at position 0, and the tape is shifted 
at each step according to the rule. There is a continuous non-injective surjection 
& : X -> X T such that <PT = T T &. 

Finally, we can have a vision centered on the head and which emphasizes only 
the relevant part of the configuration, as in [4, 5]. The system St is the one-sided 
subshift on alphabet Q x A, which is the image of the factor map tt '■ Xt — > St 
defined by Tr(x,q)t = (ya,p) if (y,p) = T T (x,q). In other words, it represents 
the sequence of pairs corresponding to the successive states of the head and the 
letters that it reads. 
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Similarly, we will note Sh the one-sided subshift on alphabet QU{AxQ) which 
is the image of the factor map th ■ Xh — > Sh defined by Tn{x)t = T H (x) . 
Unlike St, this subshift does not always contain the relevant information, since 
the head can be completely absent. 



2.1 Equicontinuous configurations 

Topological notions can actually formalize various types of head movements. 
One first example is cquicontinuity of the DS Tt- It is strongly related with 
periodicity, as the next remark establishes. This is natural since the symbol that 
the head reads in Xt is always at position 0. Hence, if the head visits an infinite 



number of cells, say to the right, any perturbation on the initial configuration 
will get to position 0, and thus will become largely significant for this topology. 
We conclude the following. 

Remark 1 Letx G X be a configuration andT a machine over X . The following 
statements are equivalent: 

1. The head position on x is bounded. 

2. x is preperiodic for T. 

3. <£(x) is preperiodic for Th ■ 

4- &(x) is equicontinuous for Tt ■ 

5. TT&ix) is preperiodic and isolated -i.e. equicontinuous in St- 

Moreover, if one of the above occurs, then i'(x) is preperiodic for Tt, x is 
equicontinuous for T and <^{x) is equicontinuous for Th- The set of equicon- 
tinuous configurations for Tt is a union of cylinders of Xt ■ 

If &(x) is preperiodic for Tt, then tt^{x) is also periodic (for cr), but x need 
not be periodic for T. For example, a machine that simply moves to the left on 
every symbol will produce a periodic point for Tt if the initial configuration x is 
spatially periodic. From the previous remark, such a point is not equicontinuous, 
and tt&(x) is a non-isolated periodic point in St, because any perturbation of x 
will produce a neighbor of r^ix) in St- Periodic points for T generate isolated 
periodic points in St because, once the system falls in the periodic behavior, its 
future is fixed. 

Preperiodicity in T also implies equicontinuity in Th, but Th may have other 
equicontinuous points. The previously mentioned machine which always go to 
the left produces equicontinuous points for Th which are not equicontinuous nor 
preperiodic for Tt- 

The following proposition states that the equicontinuity of preperiodic con- 
figurations is transmitted to factor subshifts of Th, which will be helpful in the 
sequel. 

Proposition 1 If z € Sh is a preperiodic word involving the machine head 
infinitely often, then it is isolated. 

Proof. We can assume that z is periodic, and then include the transient evolution 
in a larger ball. Let p 6 N\ {0} be the period of z; let us prove that the ball U = 

[ ,z [o,|0||A|» , + 1 (p+i) 2 ]]o of Sh is ec l ual to Lct z ' e U and x e T H 1 i z ')- lt can 
be seen that the head computing over z 1 always remains between the positions 
|_— p/2\ and |p/2j, which correspond to at most \Q\ \ A\ P+1 (p+ 1) distinct finite 
patterns. Hence there are i < j < \Q\ \A\ P+1 (p + 1) such that T l {x) = T J (x); 
as a consequence a l (z') is (j — i)-periodic. Together with cr l (z), they are both 
(j " i)p-periodic and coincide on their first (j — i)p letters, since (j — i)p < 
\Q\ \A\ P+1 (p + l) 2 - «. As a conclusion, z' = z. □ 



2.2 Preperiodic machines 



When all the configurations are uniformly preperiodic, we say that the system 
is preperiodic, i.e. there exist q, p such that T q+P = T q . In the present case, 
global preperiodicity of each of the considered systems comes directly from local 
preperiodicity of T; and it is equivalent to global equicontinuity of each of the 
systems as the next theorem establishes. 

Theorem 1 Considering a machine, the following statements are equivalent: 

1. The head position is (uniformly) bounded. 

2. Any configuration of X (or Xh, Xt) is preperiodic. 

3. T ( or Tn , T T , S T , S H ) is preperiodic. 

4- T (otTh, Tt, St, Sh) is equicontinuous. 
5. St (or Sh) is finite. 

Proof. We give only a sketch of the main implications. 

— It is quite obvious from the commutation diagrams that the preperiodicity 
of T, Tjj and Tt are equivalent, and they imply those of St and Sh- They 
also imply, from Remark 1, that the head position is bounded. 

— Clearly, the equicontinuity of T and Tn are equivalent. 

— It is known from cellular automata theory that the equicontinuity of Tjj, 
its preperiodicity, that of all its configuration and the finiteness of Sh are 
equivalent. 

— If the head position on all configurations is bounded, then from Remark 1 
they are all equicontinuous for Tt- Xt being compact, Tt is equicontinuous. 

— It is obvious that St is finite if and only if the head reads a bounded part 
of the initial configuration. □ 

2.3 Sofic machines 

Now we allow computations where the head can go arbitrarily " far" , but without 
ever making " large" movements back. 

Definition 2 We say that a machine makes a right-cycle (left-cycle,) of width 
JVeN over a configuration x G A z xQxZ and a cell ieZi/ there exist time 
steps = to < t\ < ti such that the head position is i at time and ti, and is 
i + N (i- N) at time t 1 . 

In this section, we consider machines whose cycles have bounded width, i. e. there 
exists an integer TV such that the machine cannot make any cycle wider than N . 
These machines have been studied in [5,4], where it was proved that they are 
exactly the machines for which St is sofic. 

Theorem 2 Considering a machine, the following statements are equivalent: 

1. St is sofic. 

2. All configurations of Xh that contain the head are equicontinuous. 



Proof. 



1=>2 From [4], we know that there exists an integer N such that the machine 
cannot make any cycle wider than N G N, and let x G Xh a configuration 
containing the head within [—ft, ft], for some k G N. Let us show that if 
y G [a;[_ fe _jv,fc+jv]], then for every t G N we have T H (y) G [T t H (x) l _ kM ]. Let 
us remark that while the head is inside [— k — N, k + NJ , we necessarily have 
Th(v) £ [T H (a;)[-fe,fe]]- Let us suppose that there exists jeN such that the 
head is outside [— k — N, k + N} at time j and let us take this j minimal. 
Then the heads of T 3 H (x) and T H (y) are outside [-ft - N, k + Nj. At some 
moment, the head has gone from ft to k + N (or from — fc — N); if it comes 
back to [—ft, ft], it would make a cycle. Therefore, the head cannot come 
back to [—ft, ft], and this is true both for x and y, and we have the result. 

2=>1 Conversely, assume that the head can do arbitrarily wide right-cycles in cell 
0, i.e. for each j G N there exists a cylinder [u 3 ]o of Xh with G (AxQ)A nj , 
with rij > j, such that over each configuration of [u 3 ]o, the head starts at 0, 
it visits the whole interval [0, rij\ and comes back to cell 0. Let us take some 
configuration c 1 in each cylinder [u 3 ]o- By compactness, the sequence (c J )j^ 
admits an adhering value c, on which the head necessarily goes infinitely far 
to the right without ever coming back to cell 0. By construction, for any 
N, there is some j G N such that the configuration c^_ N ^ = C[_jv,jv]- But 
there exists a time t G N such that T H (c J ) has the head in cell 0, whilst 
T H (c) has not; hence c is not equicontinuous. □ 

From [5], any of the former properties implies that any configuration is either 
prcperiodic or gives rise to a movement of the head arbitrarily far in some direc- 
tion, but the converse is not true. Any configuration of Sh is preperiodic, hence 
this subshift is numerable. 

3 Bounded-zigzag machines 

Whilst the sofic machines did not allow any large cycle, we can wonder what 
happens when allowing a single one, or a finite number of these. The first step 
is to allow one cycle of arbitrary width but to forbid two overlapped unbounded 
cycles (zigzags). We remark that two independent cycles, each on a different 
direction, are allowed in this case. 

Definition 3 We say that a machine makes a right-zigzag (resp., left-zigzag,) of 
width N G N over a configuration x G A z xQxZ and a cell i £ Z, if there exist 
time steps = to < *i < h such that the machine position is i at times t and 
ti, andi + N (resp., i — N) at time t\. We say that a machine is bounded-zigzag 
if the maximal width of the zigzags that it can make is finite. 

3.1 Complexity of St 

While bounded cycle machines have a sofic shift St, the bounded-zigzag ma- 
chines have a subshift recognized by a deterministic pushdown automata. The 



words of St contain information about the tape symbols and the head state. 
From this data, it is possible to deduce the tape symbol of the visited cells and 
the relative position of the head at each time step. In order to recognize St, we 
can register this information and check its coherence at each time step. When 
the width of the cycles is bounded, we only need to register a finite part of the 
tape (bounded-cycle machines have a subshift that can be recognized by a finite 
state automaton). 

When only one "wide" cycle can be done, we can register the information in a 
stack, from which it can be read exactly once (and is lost forever once read). This 
corresponds to the fact that the cells registered in the stack cannot be visited 
any more and zigzags cannot be allowed. The complete proof can be found in 
the appendix. 

Theorem 3 A machine T is bounded- zigzag if and only if St is recognized by 
some deterministic pushdown automaton. 

3.2 Complexity of S H 

If we now adopt a point of view fixed on the tape -Sh~ rather than the head, a 
cycle in the subshift corresponds to a waiting time during which cell does not 
change. We can adapt the previously built DPDA so that it recognizes exactly 
these waiting words between two visits of the head. The key point here is that 
these languages are unary, and unary context-free languages are regular (see for 
example [6]), and thus they can be recognized with a finite automaton. 

When the machine is bounded-zigzag, the head can make at most one long 
cycle by side. The rest of the time, the head is either moving closer to or farther 
from cell 0, or staying in some finite window around cell 0. All of these behav- 
iors can be recognized by a finite automaton, thus the language of Sh is regular. 
Therefore, we obtain a surprising reduction in language complexity when chang- 
ing the point of view: if St is recognized by some DPDA, then Sh is sofic. The 
complete proof can be found in the appendix. Note that, up to a rescaling of the 
tape alphabet, all factor subshifts can be reduced to the case of Sh- 

Theorem 4 For any bounded-zigzag machine, all the factor subshifts of Th are 
sofic. 

The converse of this theorem is false: we can construct a machine with a tape 
with n levels, where the head vertically shifts down the content of each level 
while moving right. It rebounds when it finds a wall in the lowest level (which 
is erased in the same way), and does the same in the opposite direction. We can 
see that the machine can make arbitrarily wide n-zigzags, each of independent 
length, in such a way that the factor subshifts of Th are sofic. 

Nevertheless, we can prove that this kind of construction is possible only 
with a bounded n. Let us introduce this formally. 

Definition 4 We say that a machine makes an n-cycle of width N 6 N over 
configuration x e A z x Q x Z and cell i E Z, if there exist 2n + 1 time steps 



= to < t\ < . . . < t 2n such that the head is in position i at time t 2q and 
outside [— N, NJ at time t 2q +i, for each q G [0,n]. We say that the machine is 
n-bounded- cycle if there is some N such that the head cannot make n-cycles of 
width larger than N. 

When St is sofic, the machine is 1-bounded cycle. Considering some machine T, 
we denote iPn(x) G N U {+00} the maximum n such that the machine can make 
an n-cyclc of width N over configuration x. Clearly, T is n-bounded cycle if and 
only if for some N G N, ipN is bounded by n — 1. 

Let us call <£j (x) the set of time steps for which the head has position i£Z 
when computing over configuration x. This set is linked to cycles by the following 
intuitive observation. 

Proposition 2 IfT is an n-bounded- cycle machine, then there exists p G N such 
that for any cell i G Z and any non-preperiodic configuration x G X, |#i(x)| < p. 

Proof. Let n, N G N be such that max {i/jn(x)\ x G X} = n — 1, and x G X 
such that \<P (x) \ > p = 2n \A\ 2N+1 - the case i ^ can be obtained by shifting. 
Consider {to, . . . ,t p } C &o( x ) w hh to < ti < • • • < t p . If we consider an (n — 1)- 
cycle over x in cell 0, we can see that there exist tk t < tfe 2 < . . . < ifc„_ 1} such that 
for any i G [1, n — 1], the head goes beyond iV or — N between time steps t^ and 
tki+i, but not between (possibly equal) times t^+i and tk i+1 ■ This means that tk f 
is the last time that the head is in before going beyond [— N, NJ. Let fco = — 1 
and k n = p, in such a way that [0,p] = U"=o ^*! w h ere ^* = Pi + L f° r < 

1 < n. There are n + 1 such intervals, so one of them, say I,, has at least |A| 2Ar+1 
elements; this is all the more the case for [tfc 4 +i,tfc i+1 ] 3 {ifcj | h < j < h+i}- 
Hence, between time steps t^+i and tk i+1 there are at least |A| 2JV+1 consecutive 
time steps in <l>o{x) such that the head stays within the interval of cells \—N, N\. 
As a result, there are i, j G [tfc 4 +i,tfe i+1 ] with i < j and T l {x) = T^{x), which 
implies that x is preperiodic. □ 

Theorem 5 If Sr is sofic, then T is n-bounded- cycle for some n. 

Proof. Assume that Sh = th(Xh) is recognized by some finite automaton with 
AT states, and that there exists some configuration x G X on which the machine 
makes some iV-cycle of width N. Let to, . . . ,t 2 N be as in the definition of TV- 
cycles, and u = th(x)ioj 2N [- Let 00 ■ . ■ o t2N +i be the corresponding path of the 
finite automaton. We can see that there are i < j < N such that o t2i = o t2j , 
hence there is some periodic infinite word z G th(Xh) corresponding to the path 
w that repeats the cycle (o t2i ■ ■ -o t2j ). From Proposition 1, z is isolated. As a 
consequence, w is the only path to start from o t2i ■ Therefore, its vertices are all 
different, and t 2 j — t 2 i < N, but in this case the head does not have the time to 
go beyond f—N, NJ between these two iterations, which is a contradiction. We 
have proved that T is A^-bounded-cycle. □ 

Here, too, the converse is false, since it is easy to build a machine doing a given 
number of arbitrarily wide rebounds on specific wall characters before stopping. 
The language of such a machine cannot be regular because the time intervals 
between two rebounds are not independent. 



3.3 Almost equicontinuity 



Wc have already seen that in sofic machines, almost all configurations of Xjj are 
equicontinuous. It is still so when allowing n-cycles, though in this case there 
are some configurations with head which are not equicontinuous - recall that 
Theorem 2 is an equivalence. 

Theorem 6 IfTis an n-bounded-cycle machine for some n, then Th is almost 
equicontinuous. 

Proof. By compactness of the space, it is enough to prove that for any cylinder 
[u] and any k G N, there exist some x G [u] and some to G N such that for any 
V G [z[-m,m]] and any t G N, T^(y) G [T^(x)[_ fcjfc ]]. Let N G N be as in the 
definition of n-bounded-cycle machine, [u] a cylinder of Xh and k G N. If [u] 
contains some preperiodic configuration with the head, then we can easily find to 
thanks to Remark 1. Otherwise, let us consider some configuration x G [u] (with 
the head) maximizing |<P_fc(a;) U $k{%)\, which is finite thanks to Proposition 2. 
Let m G Z be such that to > k and the interval [—to, to] contains all the cells 
visited, when computing from x, up to time step t = max($_fc(i) U <£fc(x)). 
Then we can see that any configuration y G [#[-m,m]] nas the same evolution 
as x until this time step, and that after that, its head cannot visit cell — k nor 
k, otherwise it would contradict the maximality of x. We can deduce that the 
head of x (then also y) is outside [— k, k} after iteration t, otherwise it would 
be trapped between — k and k and would become periodic. We observe, then, 
that the cells of [— k, fc] evolve exactly in the same way for configurations x and 
y. □ 

The converse is untrue: imagine a machine whose head rebounds between two 
walls, each time shifting them to the left. Every configuration where the head 
starts enclosed between two walls is equicontinuous. Any finite pattern can be 
extended by adding walls to enclose the head, therefore equicontinuous points 
are dense, but the head can make an arbitrary number of arbitrarily wide cycles. 



Conclusion 



The complexity of the Turing machine will always be very hard to understand. In 
our attempt to treat this issue through the theories of topological and symbolic 
dynamics, we have found interesting relations between: 

— the head movements that can be observed during the computation; 

— the density of equicontinuous points; 

— the language complexity of the associated subshifts St and Sh ■ 

These relations introduce a new point of view on how computation is performed. 
In addition to generalizing them to more machines, the next step would be to 
study Turing machines as computing model by introducing a halting state, and 
to link all of these considerations to the result itself of the computation, and 
eventually the temporal or spatial complexity of the computation. 
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Proofs 



The Ogden Lemma [7] is a well-know generalization to the case of pushdown 
automata of the pumping lemma on finite automata. It can be expressed on 
paths of the graph as follows. 

Lemma 1 Consider a DPDA (A, Q, T, _L, A, Oo, F), and (o , n°) . . . (o„, ^i n ) some 
path of its graph and I C JO, n\ a subset of distinguished positions of size 
\I\ > q = 2 |fi|2|r|2+1 . Then there exist four positions < h < l 2 < h < U < n 
and such that: 

3. Viepi,« 4 ],|^| > \v h \; 
I Vtell 2 ,kj,\/\ > \n l *\. 

5. (o , . . . (o h , (j, ll )(oi 2+ i, fi h+1 ) . . . (o h , fi h )(o h+1 , fi u+1 ) . . . (o„, fi n ) is also 
a valid path of the graph, where fi 1 = ^ Zl ^j|^ !2 |^ t ||/ 

6. /np 2 ,z 3 [^0; 

7. |/n[/i,i4| <q; 

8. Either I n [0, h\± ^ / n {hMl or I n [Z 3 , h\ + + I n [Z 4 , n\. 

If T is a machine with rule 5: AxQ^AxQx { — 1, 0, 1} and a,q e Ax Q, 
then we note 8a(&, q) = ft, 8q{a,q) = p and 5d(cx, q) = d if 5{a, q) = (/3,p, d). 
If u = (u, q,n) e A k x Q x Z, then we can define the corresponding cylinder in 
space X : 

[u]i = {y,p,j 6 A z x Q x Z\y e [u]i and p = q and (n e Ji, i + =>■ j = ra)} . 

Let e denote the empty word. 

Theorem 3 comes from the following lemmas. 

Lemma 2 Let N be a fixed natural number and T a Turing machine. Given two 
partial configurations u = (u,p, 0),v — (v,q,k) 6 A 2N+1 x Q x J— AT, AT], there 
exists a DFA C UtV that recognizes the language C u ^ v of the words ('TT | f r (a;))* = o 
for ( 6 N, 1 € [a] such that T l (x) 6 [v] and for any j G [0,£[ the head position 
ofTi(x) is m\-N,N\. 

Moreover, if x satisfies the conditions of C UiV , then every y G [u] also does, 
with the same time t. 

The language C UiV can be either empty, a singleton or, when v is periodic 
for T, infinite. The automaton C u>v simply simulates T by loading u on its 
memory, and making the partial configuration over cells ]— N, AT[ evolve simply 
by applying the machine rule. The next lemma corresponds to similar and more 
evolved proof. 

Lemma 3 Let N be a fixed natural number and let T be a Turing machine 
that cannot do 1-zigzags of width N. If we have three partial configurations u = 



(u,p,N),v = (v,q,k),u' = (u',p',0) E A 2N+1 x Q x N such that zt[_jv,o] = 
v l-N.o} andC u ' tU ^ 0, then there exists a DPDA R UyV that recognizes the language 
T^u,v °f the words {tt^{x))^ = q for t E N, x E [u] such that T f (x) E [v] and for 
any j E [0, t[, the head position ofT J (x) is strictly positive. 

Moreover, if x satisfies the conditions of1Z UiV! then every y such that j/jo,oo[ = 
xjo j0 o[ cdso does, with the same time t. 

Symetrically, if u = (u,p, -N),v = (v,q,k),u' = (u',p',0) E A 2N+1 xQxZ_ 
such that u [0, AT] = v JO, AT] and C u >. u ^ %, then there exists a DPDA L UiV that 
recognizes the language C UtV of the words (ir^x))*^ for t E N, x E [u] such 
that T l (x) E [v] and for any j E [0, i[, the head position of T 3 (x) is strictly 
negative. 

Moreover, if x satisfies the conditions of L u ,v, then every y such thatyj_ OOi0 ^ = 
£]_oo,o[ also does, with the same time t. 

Proof. We will do the proof only for TZ UyV . The automaton registers the states 
of the tape and updates them at each step. The states of the cells at the right 
of the head will be registered in the internal state of the automaton, while the 
states of the cells at the left will be stocked in the stack. The position of the head 
is given by the stack depth; in this way the head is always reading the symbol 

We define actually an automaton in a slightly different model than previously 
defined. The initial and terminal states actually involve the content of the stack: 
we initially push a given finite word into the stack, and to accept a word, we verify 
if both the terminal state and the stack content are in some given finite sets. It 
is easy to see, by considering some complex encoding in the stack alphabet r, 
that this model can be simulated by the previous one. The automaton R UyV has 
input alphabet AxQ, states set Q = (A^ N xQ)U {REJECT}, stack alphabet 
A- N \ its initial state is o = (un,p) and initial stack content the mirror of Mnjvr; 
it terminates when the pair composed of the internal state and the stack content 
is in F = {((w,q),n)\ v = (fj,w,q, \fi\ + 1)}; its transition function A is defined 
by: 



\{{a,p), (w,q),(3) = 



p = q and Sd{cc,p) = 1 
w = e or wq = a 
p = q and 6d{cc,p) = — 1 
iD = £orii) =tt 
REJECT in any other case. 



{{wii,N{,5 Q {a,q)),5 A {u,p)l3) if 
{(PS A (a,p)w lltN _ 2 j,q'),e) if 



Let us denote by \£ E A* and (w^ ,qi) E A- N x Q the respectively stack 
content and internal state at iteration j E N. 

— We will prove by induction on j E N, that if x satifies the conditions of lZ u ,v, 
then Ti{x) E [{n j w j , q j , \^ \ + 1)]. 

For j = it is clear, because x E [u] C [(/j,°w°, q°, N)]. Let us suppose that 
it is true for a given j E N, and let us prove it for j + 1. 
If u)j ^ e, the head is reading the symbol u>q and is in state q* , hence the only 
input accepted is (w^q^). In this case, the head will pass to state 5q(uUq, q^) 



and will move to SDiw^q 3 ). If Soiw^qi) = 1 the automaton must push 
Sa{w 3 , qi) and "erase" w . If Soiw^qi) = — 1 the automaton must replace 
u>q by Sa(w j , q J ), pop a symbol and concatenate it to w J . 
If w 3 — e, the automaton will accept (a,p) only if p = q 3 ; in this case it will 
work, assuming that w J = a. 

— Now we need to prove that every word recognized by R u ,v is in fact in 
T^-u,v We use recurrence to define the configuration x that certifies this. The 
first condition is that x G [(un,P, TV)], it follows from the first verification: 
(a,p) = (wq, q°) = (un,p). Let us suppose that we have defined x — (x,p, TV) 
such that T s {x) e [(^i s w s ,q s , \[i s \ + l)] for every s < j and that the set of cells 
visited by the head is [r, i} for some r < TV and i > J^w 7 ' | +1. Let us prove 
that the same is true for j + 1 for a suitable x' . We can note that the condition 
T 3 (y) e [(tf w 3 , q 3 , \^\ + 1)] holds for any y satisfying y^q = x^.q. 

If w 3 = e, then the automaton will accept any pair (a,p) with p — q 3 if 
cell k — \/i r \ + 1 has already been visited; the value of Tk is important and 
cannot be defined to be a. But if k was visited, its value was registered in w s 
for somme s, and it has been erased because the head has moved to k — TV 
in some moment (then k > TV). The existence of u' = (u',p',0) such that 
C u '.u 7^ insures that the head has moved from to TV, which means that, 
the head has made a 1-zigzag to the right between cells k — N and k, with 
is forbiden by hypothesis. Hence k has not been visited before {i < k) and 
we can define x' k = a. 

When w 3 ^ e, we know that the value of cell k in T 3 (x) is w 3 . The automaton 
will only accept the pair (a,p) = (w^q 3 ). This and the former construction 
insure that T 3+1 (x) E [(fj, 3+1 w 3+1 ,q 3+1 , \fi r+1 \ +1)]. □ 

Proof (of Theorem 3). 

(=>) Since St does not regards the head position, we can suppose that the 
head starts at 0. Let x be a configuration. 

— If the head does not exit the interval [—TV, TV] during the whole evolution, 
then only M is needed to recognize tt^x), we conclude that TT^(a;)[[o.fc] S 
C H-N,N h T*( x )^ N , NV for every k e N. 

— If the head exits [—AT, TV] for the first time at iteration to, by the right side, 

and never comes back to cell after that, then r T ^(a;)[o,fe] G C X[ _ N W1;T t (x) [ _ w , w ,^T*o(x) l[ _ J v, J v ] ,Tfe(x) l[ _ JV , J v ] > 
for any k. 

— If the head exits [—TV, TV] for the first time at iteration to, by the right 
side, comes back to at iteration t\, and never exit [—TV, TV] again, then 

TT&(x)lO,k} G C ^i-«,«],T*o(x),_ N , N ,'^T t o( a; ) [ _ JViJV1 ,T t i(x) [ _ JV , JV] CT'i( a; ) [ _ JV>JV] ,T'=(x) I _ NiNr 

for any k. 

— If the head exits [—TV, TV] for the first time at iteration to, by the right side, 
comes back to at iteration t\, and exits [—TV, TV] again at ti and does not 
ever come back to 0, then TT^(x)[ ,fc] is in the concatenation of the languages 

^T'o( a; ) [ _ J v, J v],T t i( a; ) [ — n ,n\ ' ^T*i (x)[_jv,jv] ,T*2 (x)[_jv,jv] ari d 

£ T*»W[_ w , W j,r*(x) I _ w , WI . for any k. 



- If the head exits [—AT, NJ for the first time at iteration t , by the right side, 
comes back to at iteration ti, exits [— N, NJ again at ti, and comes back 
to at t 3 , then TT^(a;)[o,fc] is in the concatenation of C xl _ N NhT t 0{x) l _ N _ m , 

^-T*o(x) [ _ w , N ],T' 1 (x) [ _ w , N ]' ^T t i(x) l . NiNi ,T t 2{x) l _ NiNl , ^T'2( x ) |[ _ JViJV]l T*3(x) I _jv,iv] 

and C TtHx)l _ N NhTHx)l _ N _ NV for any k. 

The analogous case when the head first exits [—AT, NJ through cell —N — 1 
can be treated in a similar way. We conclude that for any x and any k, the word 
TT?? - (a;)[o i fc] is in the language 

[J C„o,™lJ (J C u o v oK v a w [J (J ^,o iU iC u i iU ,U 



jU 1 ,6 1 ,io -u ,-u 2 ,u> 

[J C„o,6°A ,tu[J [J C u O |6 o£ 6 |U iC u i )t(J 

U <WAo 

-u°,&° jtt 1 ,iu u° ,6° ,u 1 .u 2 ,w 

where w l G A 2JV+1 x Q x {0}, G A 2N+1 xQx {N}, b l G A 2JV+1 x Q x {-AT}, 
and u> G A 2Ar+1 xQx f—N, NJ. This language is recognizable by a DPDA since 
it is a concatenation and union of languages which are recognizable by DPDAs, 
thanks to Lemmas 2 and 3. 

We have to prove now that this union of languages contains only words of 
C(St)- The proof is similar for each of the listed languages; we will develop it 
only for C u o tV olZ v o ;U iC„i ^1 C b i jt0 . 

From Lemma 2, we know that if C u o v o ^ 0, then any x G [u°] will sat- 
isfy TT^(a;)[o.t j G C u o v o if the head position at time to is N. From Lemma 3, 
if 1Z v o u i ^ 0, then there exists y G [v°] and t\ such that T tl (y) G [u 1 ] and 
TT&(x)it , tl } G 7^o ;U i . We define £[jv,oo[ = 2/[JV,cjo[> which will satisfy ^^(ar)^,^] G 
C u o >v o1Z v o jU i . From the same lemmas, we know that the values of x on ] — 00, —NJ 
are still "free" and T tl (x) G [w 1 ] gives "Pr<^(x)[ tl)t2 j G C u i jb i, where ti is the in- 
stant in which the head reaches the cell — AT for the first time. 

We can suppose that C b i iW is not empty - otherwise the result is trivial. Then 
there exists y' such that T k (y') G [w] and 77^(2;) p 2i fc] G -Cft 1 ,™- The values of y' 
over ]— -/V, 00 [ are not important and we can fix them to those of T t2 (x), or in 
other words, to define xj-oo.-at] = 2/]-oo,-jv]- We obtain 

TT^(a;)[o,fe] ^ C u o v oTZ v o u iC u i ib iC b i^ w . 

This completes the proof. 

(<=) Let us assume that the language of St is recognized by some DPDA M, 
that p is as in Lemma 1, and that the machine can do a 1-zigzag of width N = 
p + 3; we can easily find some configuration x with time steps < t\ < t 2 < t 3 
such that the machine visits cell 1 at time 0, cell AT at times t\ and ts, and cell 



at time t 2 . It can also be assumed that the zigzag is minimal, in the sense that 
no other configuration satisfies the condition with a lower t%. Moreover, we can 
assume that t\ is the last time when cell N is visited before £3, and t 2 is the first 
time when cell is visited. Note that t 2 — t\ > N. Let c = (00, fi°) ■ ■ ■ (o t3 ,// 3 ) 
the corresponding path in the graph of M. 

The key point of the proof is that, thanks to the determinism of the automa- 
ton, given w £ C(St), the i — th cell is visited by the head for the fist time if and 
only if the corresponding vertex in the graph of M has out-degree more than 1. 
Since the out-degree of a vertex (q,u) of M depends only on (q,uo). Let V be 
the set of vertices with out-degree 1, and L be the subset of V corresponding to 
vertices whose unique out-neighbor is not in V and such that this unique tran- 
sition corresponds to a left movement of the head. These vertices represent cells 
which are at the left extremity of some visited zone. For instance, note that the 
vertices (o tl+ i, . . . , (ot 2 -i, // 2_1 ) are in V since the corresponding visited 

cells are between 1 and N, and (o t2 -i, M* 2_1 ) i s the first vertex of the path c to 
belong to L. 

If we apply Lemma 1 with / = }t\,t 2 — 1[[, we obtain time steps < h < 
h < h < U < *3 such that 

5 = (o , . . . K , » ll )(o l2+u . . . (o h , fL h )(o u+u . . . (o t3 , f/ 3 ) 

is a valid path in the graph of M, i.e. it can be obtained from some configuration 
x, which we can suppose to have the head in cell 1 without loss of generality. 

— First, suppose I4 > t 2 — \. Since \I n }h, Uj] < p, we must have l\ > t\. More- 
over, the nonemptiness of Ifl]^, I3J gives t\ < l\ < l 2 < t 2 — 1 < U < t%. The 
vertices of d — (o^ , . . . (o t2 -i, M* 2_1 ) are m then d is the only subpath 

of this length starting at (o h , ^ h ). Thus, (o h , fj, h )(o h+1 , /x' 2+1 ) . . . (ot 2 -i-i 2+h , ^-^-h+hj = 
d. In particular, (o t2 ,/i* 2 ) = (o t2 _; 2+ ; 1 , ^* 2 ~' 2+Zl ). From the lemma, (o t2 ,/iQ 2 ) = 
(o t2 ,/Xp 2 ); the same automaton rule is applied in both vertices, and since 
(o t2 ,fi t2 ) is not in V, we conclude that (o t2 _i 2+ ; 1 ,^* 2_ ' 2+ ' 1 ) ^ V. This re- 
sults in li — l 2 , and from the Ogden Lemma we get I3 < I4 < t 2 , which is a 
contradiction. 

— Now suppose that I4 < t 2 . As no vertex of c is in L before (o t2 _i, ^* 2_1 ), 
we can see that, in this path too, the vertex (o t2 ,// 2 ) corresponds, at time 
*2 — h + h — h + h , to the first visit of cell - at the first time we go more to 
the left than the visited zone. Since both paths coincide after that, the head 
does the same movements, and we obtain that its position at the last vertex 
(o t3 , fi ts ) of path c is N. But, from path c, we know that (ot 3 , ^* 3 ) S V, so on 
x too the machine had already visited cell N before arriving on this vertex. 
It could not be after time t 2 — I4 + Z3 — I2 + h, since from then on we have 
followed the same positions as in c, hence c represents a 1-zigzag; from the 
last point of the lemma, it is shorter than c, so x satisfies the construction 
hypotheses of x but contradicts its minimality. □ 

Proof (of Theorem 4). Let us define the following languages. 



Tlu,v = {uq \ 3w G fcu, v , \w\ = k) 
C u ,v — { Wo I 3w G w = fc} 

It is a context-free language since it is the transformation of a context-free 
language through a letter morphism. It is also a regular language because it uses 
a single symbol uq. If x and f satisfy the conditions of 1Z UiV , then T#<£(x)[ .t_i] £ 

We also define the language C u , v of the words TH${x)\o,tl with ( 6 N and 
.t G such that T*(x) G [u 1 ] and for any 7 G [0,i[, the head of T j (x) is in 
]-7V,7V[. 

It is recognized by an automaton that simulates M and accepts a pair (ot,p) 
if and only if the current head position is 0, and p and a match the simulation. 

If the head starts at cell 0, the analogous concatenation and union of the Cs, 
IZs and Cs would represent C(Sh)- But if the head does not start at 0, we need 
to consider, for u = (u, p, 0) 6 ^42^+! xQx {0}, the language B u of the words u 
for which there exists x with T'(x) € [u] and for any j < t, the head of T^{x) is 
not in cell 0. B u represents the set of sequences of states observed at cell until 
the head reaches it, when the partial configuration u is observed in \— N, NJ. 
B u is always an nonempty "interval", i.e. B u = { Uq \ < t < n} for some n E N 
which may be - if u is a "garden of Eden" . 

Since B u is either finite or equal to {u | t G N}, it can be recognized with 
a DFA B u . C(Sh) will be the concatenation and union of Bs and the other 
languages. 

Globally, we obtain that tf<P(x)^ ^j is in the following union: 

{ x o}|J U Bu oC u°,w{J [J B u oC u O tV o7l v O iW [J [J B u aC u a v all v a u iC u i iW {J 



U U ,V U ,U L .W 



vP ,v° ,u x .w u° ,v° jU 1 ,6 1 ,w 2 ,iu 

[J B u oC u o ib o C b o^ w [J [J B u oC u o ib o£ b o iU iC u i iW [J 

u° ,b° ,w u° ,b° ,-u 1 ,w 

[J B u oC u o^o£ b o i7Z v i jU 2C u 2^ w .□ 

u° .b° .u 1 .v 1 .w u° ,b° .u 1 .v 1 ,u 2 .w 



